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Annotation. The article is devoted to the analysis of existing methods of searching for explosive objects on the 
surface of the earth and under it, and to the development of new effective approaches to solving the problem. We focus 
on developing solutions based on AI technologies and methods that use publicly available hardware, structural methods, 
and machine learning methods The problems and their solutions mentioned in the article are quite specific and, despite 
the relevance of the topic of searching for explosive objects, poorly developed. The main reason for this situation is either 
the lack of information in the public domain, when developments are carried out by military departments or private 
companies, or the relatively low development of countries that suffer from the problem of demining territories where 
military operations have been or are being conducted. From 2014 to 2022, on the territory of Ukraine, the area affected 
by explosive objects was approximately equal to the area of Croatia, which took 20 years to clear the territories after the 
war in the Balkans (1991-1995). After 2022, the territory affected by explosive objects increased several times. The 
intensity of shelling can currently be compared to the First and Second World Wars, so it is safe to say that the problem 
of finding explosive objects has reached a higher level. Therefore, considering the volume of data and the scale of the 
affected territories, we decided to study the main directions and modern methods of searching and classifying explosive 
objects in order to use them to create a system or a framework for solving the given task. The results of this article are 
planned to be used to create a single algorithmic environment for solving the problems of finding explosive objects, 
which, if necessary, will be able to process data from different sources of information, with different degrees of detail and 
depth. 
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Introduction State of the industry 

The problem of recognizing explosive Scientific findings from a broader topic 
objects is of urgent importance for modern — the identification of underground objects — is 
Ukraine and the future post-war period when used in archeology, geology, construction, and 
thousands of unexploded ammunition and other fields related to soil scanning. Private 
mines will remain. The area that is potentially companies have their own developments that 
dangerous can be incredibly large, and the are not available to the public. Software and 
number of dangerous munitions and other hardware are mostly focused on human 
explosive objects is constantly increasing. The interpretation, but with some data analysis and 
presence of plastic mines makes even tested image enhancement, so it all depends on the 
areas dangerous in the future. Despite the work quality of the images, the capabilities and 
on demining and disposal of munitions, the settings of the software, and the experience of 
dangerous area requiring analysis for the person interpreting the data. The latest 
explosive objects is 174 thousand square works in the field of determining the location 
kilometers by the beginning of 2023, which is of explosive objects focus not so much on 
30% of the total area of the state. The inventing new methods, but on improving the 
development of a mathematical model of the results of existing ones, reducing energy costs, 
explosive object search system will allow for processing data from several types of sensors, 
the creation of a remote search and monitoring using the cheapest possible equipment, etc. In 
system, as well as horizontal scaling of the Ukrainian science, this branch is _ poorly 
search process. represented and is mainly focused on 
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underwater demining and searching using the 
principle of a metal detector [5]. 


Analysis of existing approaches and 
methods 

One of the most popular methods of 
detecting explosive objects are GPR (Ground 
Penetrating Radar) systems. They are popular 
all over the world and covered in many works. 
It is these methods that are mainly covered in 
this article. Attention is also paid to methods 
using infrared radiation and visual analysis. 

In the article [1], the authors very widely 
and meaningfully analyze the existing 
approaches to the search for explosive objects, 
use different methods of identifying objects 
underground, apply different algorithms. The 
complexity of processing data from sensors is 
emphasized due to the variety of conditions 
when conducting experiments, the need to 
adjust the equipment to specific conditions, 
such as the type of soil, depth of mine laying, 
weather conditions, antenna frequency, etc. 


Fig. 1. Appearance and principle of operation of GPR. 


The large number of indicators that need 
to be considered when searching for mines 
leads to the need for a lot of computing power. 
Infrared (IR), electromagnetic induction 
(EMI), and ground penetrating radar (GPR) 
images are the most effective and simplest. 
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Among the disadvantages of the above 
IR methods, it can be noted that the accuracy 
of the search result is greatly affected by such 
factors as oncoming light, fog, rain, limited 
depth (the maximum depth is 20 centimeters), 
etc. EMI only detects metallic objects, while 
GPR requires a large amount of information to 
process and complex calculations. However, it 
is the GPR images that are worth paying 


attention to, given that deep learning 
technologies and the latest specialized 
computers reduce the computational 


complexity of this approach. In Fig. 2. the 
principle of GPR operation is given. 
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Fig. 2. Principle of GPR operation. 


Among the common algorithms used in 
the search for explosive objects are the Method 
of Moments, the Fourier Method, the Long 
Line Method and other analytical methods. In 
the comparative table of the article [1] (table 
1), it can be noted that the maximum depth for 
all methods is 20 centimeters, according to the 
ratio of the weight of the measuring complex, 
the type of objects (plastic and metal) to be 
determined, the height of the experiment (4 
meters ), GPR stands out, although it has the 
second most expensive cost according to the 
analysis from the article. 

We believe that as one of several 
methods in further research, it is the analysis of 
GPR images that is worthy of attention for 
further research and analysis. For this, it is 
necessary to obtain or create datasets with so- 
called GPR B-scans, also called radagrams, in 
which objects underground are examined with 
the help of electromagnetic waves and 
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visualized as hyperbolic patterns in two- 
dimensional space. 

Radagrams are characterized by high 
complexity of interpretation, so their correct 
analysis requires the help of an industry expert. 
The use of the latest methods of deep learning 
(Deep learning), generation (a program for 
generating B-scans gprMax), augmentation, 
Generative Adversarial Networks will help 


properly train the model to identify the desired 
objects. At the same time, the experience of an 
industry expert is needed only during the 
training process. The GprMax synthesis 
program is often used to generate radagrams, 
but finding and creating real images for 
training will be considered a priority area for 
further research. 


Table 1. Comparative characteristics of the methods 


Method Detected object 


Acoustic-sesimic Plastic or mine cover 


GPR Plastic or mine cover 
EMI Metal mine cover 
IR Plastic or metal mine cover 
NQR Plastic or metal mine cover 
TNA Plastic or metal mine cover 
with its explosive 
Neutron Plastic or metal mine cover 
backscattering with its explosive 
X-ray Plastic or metal mine cover 
backscattering with its explosive 
MAD Plastic or metal mine cover 


It should also be noted the complexity of 
building models for B-scans in the gprMax 
program [11]. Here, the emphasis is on 
creating artificial obstacles such as tree roots, 
rocks, and other objects when generating 
training images. Modern computers from 
NVidia, used in the field of autonomous 
driving and having extremely high computing 
power, can handle complex calculations when 
working with a large amount of data from 
GPR. The relatively small weight of the device 
for creating GPR images will allow using 
robots or drones. 


In article [2], three neural networks are 
used for the analysis of radiograms (Fig. 3) to 
determine the shape of the object under the 
ground, material, and additional features, such 
as depth, size, etc. The authors note that 
currently many studies focus their attention on 
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the recognition of cylindrical objects, while 
few have been engaged in the full classification 
of objects. The gprMax program [11] is used 
to generate the dataset, which is a de facto 
standard program for similar _ studies. 
According to the results of the work, the shape 
of objects is determined in an average of 90% 
of cases, the material in 99-100%, and the 
depth has a larger range of average error values 
- from 4 to 16 percent. The research has good 
results, but the approach using multiple neural 
networks is not flexible and requires constant 
addition or modification of existing networks. 

The research also uses generated data. 
This approach is often used, but to get as close 
to reality as possible, real data is needed. The 
lack of a sufficient number of samples in 
datasets is a common problem in the subject 
area. 
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Fig. 4 Using convolutional networks (CNN) 


The article [3] (Fig. 4) is devoted to the 
determination of mines underground, where it 
is proposed to classify the synthesized data (B- 
scans) according to the principle of 
presence/absence of mines. However, training 
is conducted at pre-prepared facilities. gprMax 
is used for testing. Moreover, as a result of 
testing, the accuracy is 95%. This method 
gives good results, but still, the analysis is 
performed only on _ synthesized images. 
However, as the authors themselves note, the 
95% accuracy can be improved. 

The use of deep learning methods is 
proposed in [4] (Fig. 5), where the authors 
study the problems’ of recognizing 
underground objects (on B-scans with GPR) 
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on roads to detect gas accumulations, 
underground infrastructure, sewage, and water 
pipeline leaks, etc. Unlike many similar 
studies, the authors study not only the 
definition of hyperbolas on GPR B-images, but 
perform the classification of the entire range of 
images. Attention is also paid to obstacles such 
as hatches (these objects are removed from the 
analysis results). This study has excellent 
results, but is limited to use exclusively on 
roads. For classification, several sets (hatches, 
separating boundary of layers, hyperbola, soil) 
are selected, on which training takes place and 
additional processing is required when adding 
new classifiers. 
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Fig. 5. Use of deep learning (Deep learning) 


In study [6], the approach with 3-raw 
average subtraction is studied, and on the 
example of the application of two machine 
learning algorithms - KMeans and KNN - 
objects are detected with high accuracy. 
However, the working dataset is small and not 
aimed at creating problems in recognition, if 
images with a larger number of classes are 
added to the dataset, there is no certainty that 
the algorithms will produce the same high 
accuracy. 

Groundwork was carried out by the 
authors in work [7], where they study the 
search for explosive objects from different 
angles (Fig. 6). 
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Fig. 6. Search for explosive objects from 
different angles 
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However, the analysis is performed by a 
person in the Rad Explorer software complex. 
Summarizing the above-mentioned 
works using GPR, the following conclusions 
can be drawn: 
e Datasets insufficient in size; 
e The leading role of human in learning 
and identifying objects; 


e The proof of the results is done 
experimentally, with limited and _ often 
artificial and adjusted datasets, and the 


obtained accuracy is questionable; 

e A small number of classes take part in 
the classification of objects, that is, for new 
classes, algorithms will have to be redesigned, 
or layers of neural networks must be added, 
sic; 

e Deep learning approaches, for example, 
CNN, are trained on synthetic datasets, and 
those that are generally ideal and in real use 
may give larger errors. 

Considering that GPR has a certain 
number of disadvantages, but is widely used in 
research [8], the authors of this paper plan to 
use GPR to search for explosive objects. 
However, before that, it is planned to 
investigate other two methods: 


e search using a thermal camera; 
e analysis of data from a regular video 
camera with high resolution. 

Visual methods of detecting explosive 
objects using a camera are currently very 
relevant due to the large number of ground 
explosive devices in occupied and de-occupied 
territories of Ukraine, including in buildings, 
on the outside of structures, trees, etc. The 
article [12] gives an example of the 
construction of a cheap system used to search 
for explosive objects that are not visible on the 
surface. In the article [13], the authors create a 
system of visual recognition of explosive 
objects with the help of a robot, the accuracy 
of the determination is about 90%. The value 
of the results of this work also lies in a useful 
comparative analysis of some methods that we 
want to apply in further research - visual search 
and ground scanning. Moreover, the infrared 
cameras presented in Table 2 differ from the 
thermal cameras mentioned above. Unlike 
active infrared radiation, a thermal camera is 
passive, and its accuracy does not depend on 
weather conditions. 


Table 2. Comparative characteristics of the methods 


Sensing Cost Energy Quality | Usability Ground Object 
Technique Consumption of under Penetration Material 
Images Various Independency 
Weather 
Condition 
s 

Camera v v v v x v 
Infra Red v A x = v x 
Ultrasound v ¥: x v v ¥ 
Ground x x x x v if 
Penetrating 
Radar 


A camera using thermal sensors has been 
little researched. It is often confused with an 
infrared camera. Recently, this direction is 
considered one of the most promising methods 
[9], the work [10] considers the use of drones 
equipped with thermal cameras (Thermal 
imaging systems). CNN is used for data 
analysis. The article does not reveal the details 
of the study, there are no results. 

Unlike active infrared cameras, which 
use the properties of short-wave infrared 
radiation, thermal cameras are passive and 
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recognize medium and long-wave infrared 
light. 

We consider this technology worthy of 
attention in further work. 


Conclusions and direction of further 
work 

The information analyzed during the 
preparation of this article allows us to conclude 
that no single method is sufficient for the 
maximum disposal of all explosive objects on 
the territory of Ukraine. We consider the most 
promising methods to be methods that use 
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images from video-thermal cameras and GPR. 
The availability of industrial unmanned aerial 
vehicles (UAVs) allows the combination of 
equipment and the use of various information 
to search for explosive objects, the research 
aims to remove the human from decision- 
making, as well as to minimize participation in 
the learning process. The possibility of 
covering large areas with a diverse landscape 
gives hope for the maximum cleaning of our 
country from explosive objects. 

The results of this article are planned to 
be applied to create a common algorithmic 
environment, a framework that allows the use 
of several algorithms to solve the problems of 
finding explosive objects. For each approach, 
have a solution that will have one or another 
application. Depending on the set accuracy, it 
is possible to obtain the desired accuracy or 
depth of detection by increasing the number of 
methods. For example, to search for PMF1, the 
so-called "petals" [14], visual information is 
sufficient, 


Fig. 7. PMF | and visual scanning 


However, if there is snow on the ground, 
you need to add a thermal camera for the same 
task, if you want to scan more than, say, 10 cm, 
you need to add a ground scanning radar 
(GPR). 

For the maximum effect for the search 
for explosive objects, it is suggested to present 
the result in the form of the following sets or 
classes: 

e missing objects at all; 

e objects are present, but they are not 
explosive; 

e itis uncertain whether explosive objects 
are present or not; 

e explosive objects are present. 

Such separation will allow building 
application systems of various nature. For 
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example, the first and second classes will make 
it possible to lay routes through minefields, 
while the third and fourth classes will allow to 
build accounting systems of dangerous objects 
for further demining. 

Or you can apply a similar division into 
classes, but slightly differently, as in Table 3: 


Table 3. Breakdown of results into classes 


Non-explosive objects 
are present 

There are no explosive 
objects 


Explosive objects are 
present 
There are no explosive 
objects 


To improve training, it is planned to 
apply Generative Adversarial Networks 
(GANs) and data augmentation, gprMax will 
help to enrich the datasets (in the case of using 
GPR). 

Possible obstacles during the study: 

e If the enemy aims to create an obstacle 
to detect an explosive object, it will be difficult 
to bypass, so you will have to add processing 
of other sensors, such as electromagnetic field 
measurement, infrared sensors, etc. Such 
objects should be assigned to the third class (it 
is uncertain whether explosive objects are 
present or not); 

e Homemade explosive devices must also 
be taken into account, so objects such as pieces 
of pipes, cans will fall into false-positive and 
vice versa, homemade mines will be classified 
as pieces of pipes, etc., ie. false-negative 
classes (see the confusion matrix in the table 
4); 


Table 4. Prediction results (confusion matrix) 


Actual Value 
(as confirmed by experiment) 


positives negatives 

oy w 
3 3 ie TP FP 
6 o ie T 

o = rue False 
> s ie ie ae 
——— © Positive Positive 
rT) ce} 
~ Oo a 
cea é FN TN 
@ 3 & False True 
a s ie Negative Negative | 


e Searching a large dataset is a very 
important issue, training on synthetic data can 
lead to a noticeable error; 
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Possible developments and 

enhancements: 

e creating a system that, in case of 
difficulties in identifying the object, can adjust 
the equipment, for example, for deeper 
scanning, or scanning under all courses; 

e analysis of 3D structures; 

e involvement of volunteers with their 
equipment, on which the software will be 
installed; 

e Building a framework capable of using 
several sources of information to increase the 
accuracy of the determination. 
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